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ABSTRACT 


A  multiple -epoch  signal  consists  of  several  signals  which  for 
one  reason  or  another,  overlap  one  another.  The  purpose  of  this  re¬ 
port  is  to  design  a  procedure  for  the  detection  of  the  individual  epochs 
of  the  overlapping  signals  and  to  represent  them  properly.  The  mul¬ 
tiple-epoch  signal  may  be  corrupted  with  random  Gaussian  noise  of 
zero  mean.  The  individual  signals  are  assumed  to  be  representable 
by  a  set  of  exponential  functions  with  acceptable  error,  and  the  ex¬ 
ponents  of  this  set  of  exponentials  are  assumed  known.  Any  two  ad¬ 
jacent  epochs  are  assumed  to  be  separated  at  least  T^  seconds  apart. 

For  the  signal  uncorrupted  with  noise  a  criterion  based  on  the 
error  energy  is  described  which  is  of  theoretical  interest.  This  crit¬ 
erion  is  useful  for  the  detection  of  first  epoch  only.  To  detect  the 
second  epoch,  the  first  signal  is  subtracted  from  the  original  signal 
by  means  of  the 'complementary '  operator  concept.  For  a  noisy  sig¬ 
nal,  a  likelihood  ratio  criterion  is  proposed.  Our  preliminary  ex¬ 
perimental  results  carried  out  on  a  digital  computer  justify  the  theo¬ 
retical  study. 
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INTRODUCTION 
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A  multiple-epoch  signal  consists  of  several  signals  which 
for  one  reason  or  another,  arrive  at  the  receiver  (or  measuring 
apparatus)  by  different  amounts  of  time  delay.  The  time  delays  of 
the  individual  signals  are  unknown,  and  their  differences  are  relative¬ 
ly  small  so  that  the  signals  overlap.  The  individual  signals  are  of 
similar  nature,  but  may  have  different  waveshapes.  A  multiple- 
epoch  signal  may  be  an  electro-magnetic  signal  like  radar  signal,  or 
biological  signal  such  as  speech  or  electrocardiogram,  or  signals 
of  other  origin.  It  may  be  corrupted  by  random  noise.  Our  problem 
is  then  to  find  the  individual  epochs  of  the  individual  signals  in  a 
multiple -epoch  signal,  and  to  represent  them  properly.  In  other 
words,  our  purpose  is  to  separate  multiple -epoch  signal  into  over¬ 
lapping  signals,  which  may  be  described  individually. 

To  show  how  we  proceed  to  solve  this  difficult  problem, 
we  would  like  first  to  make  clear  the  following  assumptions: 

1)  The  individual  signals  that  constitute  the  multiple -epoch 
signal  are  essentially  exponential.  Or  more  clearly,  these  individual 
signals  may  themselves  be  approximated  in  the  least- square  sense 
with  acceptable  error  by  a  set  of  exponential  functions.  The  sinusoi¬ 
dal  signals  are  only  particular  cases  of  exponential  signals.  Since 

the  exponential  functions  serving  as  component  functions  for  the  sig- 

1 

nal  approximation  are  completed  ,the  least-square  error  in  the 
approximation  of  any  signal  may  be  reduced  to  as  small  as  we  wish 
by  using  sufficient  number  of  exponential  functions.  Therefore  the 
assumption  of  signals  being  essentially  exponential  does  not  lose  the 
theoretical  generality.  Yet  it  does  impose  some  practical  limitation 
to  the  waveform  of  the  individual  signals. 
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2)  A  physical  signal  v(t)  starts  from  t  =  0  and  extends  into 
future.  As  pointed  out  by  Huggins^,  any  physical  operation  can 
operate  only  upon  the  past.  This  nature  is  inherent  in  the  analysis 
of  signals.  The  representation  and  separation  of  signals  cannot  be 
achieved  until  all  the  information  concerning  the  multiple  epoch 
signal  is  available.  A  very  simple  and  practical  solution  to  this 
difficulty  is  to  reverse  the  signal  in  time.  This  can  be  very  easily 
realized  on  a  digital  computer  or  using  magnetic  tape  in  the  analogue 
case.  Let 

f(t)  =  v(-t)  ,  (1.1) 

then  the  signal  f(t)  extends  in  the  interval  -go  <  t  :£  0.  The  signal 
f(t)  will  be  represented  (or  approximated)  by  growing  exponentials 
(as  versus  damped  exponentials).  In  this  report,  whenever  we 
talk  about  f(t),  we  assume  they  are  signals  of  this  nature. 

3)  The  exponents  of  the  exponential  functions  that  constitute 
the  overlapping  signals  are  assumed  known  a  priori.  I  would  like  to 
emphasize  here  that  this  assumption  is  completely  unnecessary 
except  for  the  considerable  simplification  of  presentation.  Suppose 
the  multiple -epoch  signal  f(t)  consists  of  n  overlapping  signals  f.(t), 
one  may  write 

n 

f(t)  =  Y  -GO  <  t  s  0  ,  (1.2) 

i  =  1 


where  the  overlapping 
m 


Il(t)  s  I 

k=l 


signals  can  be  written  as 

'*ki'  )• 


(-GO  <  t  5  tj) 


o 


=  0  , 


(tj  <  t) 


.  (1.3) 


JL  ‘i 
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®k’  positive  real  numbers  and  are  complex  conjugate 

coefficients,  t^  are  individual  epochs  such  that 

t,  <  t,  < . =  0  •  (1-4) 

12  n 


It  should  be  noted  that  and  may  be  zero  so  that  each  individual 
signal  may  consist  of  different  exponential  functions.  Our  assump- 
tion  says  that  Qj^  and  are  known  while  the  coefficients  are 

unknown.  In  terms  of  signal  space  concept,  each  individual  signal 
may  be  regarded  as  a  signal  vector  in  the  signal  space.  Then,  our 
assumption  means  simply  that  we  know  the  smallest  subspace  which 
contains  all  individual  signal  vectors,  yet  the  individual  signal  vec¬ 
tors  per  seare  unknown.  In  the  case  that  the  individual  signals  are 
not  exactly  representable  by  exponentials,  we  assume  the  we  know 
the  2m -dimensional  exponential  subspace  that  contains  the. maximum 
average  projection  of  individual  signal  vectors. 


4)  The  signal  may  or  may  not  be  corrupted  with  noise. 

For  the  noisy  case,  it  is  assumed  that  the  random  noise  is  gaussian 
and  has  zero  mean.  The  variance  of  this  gaussian  noise  is  unim¬ 
portant  for  our  problem.  We  shall  first  treat  the  multiple -epoch 
signal  without  noise  and  then  extend  the  procedure  to  the  noisy  case. 


5)  As  we  mentioned  at  the  beginning,  a  multi-epoch  signal 
is  formed  by  several  signals  whose  epochs  are  different  yet  close 
enough  to  cause  overlapping.  We  now  assume  that  for  any  two 
adjacent  epochs. 


t 


i  +  1 


t.  s  T 
1  o 


(1.5) 


where  T^  is  a  predetermined  quantity.  This  is  important  since  we 

shall  utilize  the  information  between  t.  and  t.  +  T  to  separate  the 

1  1  o 

signal  f^{t)  from  the  rest.  The  separation  is  achieved  by  means 
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3 

of  the  so-called  'complementary*  operator  concept  .  Thus  If  we 
have  a  way  to  detect  the  first  epoch  t^,  we  may  utilize  the  inform¬ 
ation  in  the  time  interval  (t. ,  t.  +  T  )  to  find  f.(t)  amd  subtract  it 

1  1  o  1 

from  f(t).  The  detection  of  second  epoch  t^  is  then  reduced  to  the 

same  problem  as  detecting  t^.  Similarly,  once  we  detect  the 

epoch  t.,  we  may  subtract  f.{t)  from  the  signal  fj(t)  +  ^  ^(t)  +  •  •  • 

+  f  (t)  so  as  to  make  possible  the  detection  of  t,  .  ..  This  is  indeed 
n  *  1+1 

the  main  strategy  we  propose  for  the  solution  of  multiple-  epoch 
problems.  The  procedure  should  become  clear  as  we  proceed  to  dis¬ 
cuss  in  detail  the  method. 

In  this  last  paragraph  of  the  section,  we  would  like  to  say 
a  few  words  about  the  reason  why  the  third  assumption  is  indeed 
unnecessary.  For  a  single-epoch  signal  which  is  exactly  representable 
by  say,  2m,  exponential  functions,  there  exist  in  literature  a  Prony’s 
method  and  its  various  modified  versions  to  find  these  exponents 
provided  that  the  value  of  m  is  known^.  Furthermore  this  knowledge 
of  m  does  not  impose  any  limitation  at  all  since  there  is  a  method 
to  test  the  value  of  m.  One  may  first  assign  a  value  M,  then  if 
M  >  m,  a  certain  determinant  will  become  singular,  euid  on  the 
other  hand  if  M  $  m,  this  determinant  will  not  be  singular.  Thus 
one  may  take  the  largest  M  which  does  not  cause  the  determinant 
to  become  singular  as  our  natural  choice. 

The  Prony's  method  does  not  give  us  the  optimum 
exponents  in  the  least  square  sense  if  our  signal  is  to  be  approximated 
by  2m  exponential  functions.  Recently,  McDonough^  has  shown  an 
iterative  method  which  converges  to  the  least-square  optimum 
exponents.  Since  the  tail  of  the  multiple -epoch  signal  consists  of  all 
the  exponentials  that  constitute  the  individual  signals,  we  may  apply 
the  Prony's  method  or  McDonough's  method  to  the  signed  f(t)  in  the 


time  interval  (-oo,  t^)  where  ^  ^  case  the  signal  is  corrupted 

with  relatively  large  noise,  a  low-pass  filter  is  required  to  filter 
out  the  high  frequency  noise  before  we  apply  the  Prony's  or 
McDonough's  method.  However,  it  does  not  mean  that  the  problem 
is  reduced  to  the  case  of  noise-free  signal.  Since  the  low-pass 
filtration  destroys  the  epoch  ixiformation,  we  shall  deal  with  the 
original  noisy  signal  in  epoch  detection. 
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11.  SIGNAL  ANALYSIS  USING  ORTHONORMAL  EXPONENTIALS 


The  ordinary  exponential  functions  are  not  orthogonal,  i.  e. . 
they  are  correlated  with  each  other.  If  one  uses  these  functions 
directly  for  signal  representation,  the  result  will  be  extremely 
sensitive  to  slight  numerical  errors.  The  orthonormality  of  two 
functions  in  time  domain  is  defined  as 

°°  ^.(t)  ^^(t)  =  6^^  ,  (2.1) 

o 


where  6.. 

ij 


is  the  Kronecker  delta, 


j 

i  =  i 


(2.2) 


The  exponential  fiuictions  may  be  orthonormalised  by  a  suitable 
linear  combination,  resulting  in  a  set  of  so-called  orthonormal 
exponentials.  Geometrically,  the  orthonormal  exponentials  form 
a  set  of  orthogonalized  coordinates  in  a  signal  space  which  is  indeed 
the  same  as  that  formed  by  ordinary  exponentials. 

5 

As  first  pointed  out  by  Kautz  ,  the  orthonormalization  of 
exponential  function  may  be  carried  out  in  frequency  domain  much 
easier  than  in  time  domain.  Given  a  set  of  exponential  functions 
with  poles  at  a  set  of  orthonormal  exponential  functions 

may  be  constructed  in  the  frequency  domain  as  follows 


®"Y2k-l 

*2k-l  ""  ®2k-l  ~Z 


7[ 


*2k  "  ®2k 


s  +Pj^8+qj^  1  =  1  8  +p.s+q. 


'2k 


8 


k-1  2 

IT  ** 

1=1  s  +p^8+qj 


(2.3) 


where 


and  B'a  are  the  normalization  factors.  The  zeros,  y'**  can  be  chosen 
rather  arbitrarily  under  the  restriction  of  orthogonality  in  frequency 
domain  that^ 

•'-joo 


In  our  case,  this  is  equivalent  to 

joo  ,  . 

r  n  o  ^"■■^Zk-l^ 

J  .  ®2k-l®2k  71. - 

-joo  (s  -pj^«+qjj) 


or 


<-^zk>  a.  .  „ 
(2.6) 


®2k-l®2k 


Vj2k-1^2k 

2Pk^k 


=  0 


(2.7) 


Thus  the  only  restriction  on  the  zeros  is 


''^2k-l72k  "  ■ 'Ik  • 

5 

Kautz  chose  the  zeros  in  such  a  way  that  ^  ” 

■  Ak-  decided  to  choose 

'<Zk.l  =  “ 

V2k=~  (2.9) 

for  simplicity  of  instrumentation.  In  this  way,  one  function  is  the 
derivative  of  the  other,  and  the  resultant  orthonormal  exponential 
functions  are 


J%  and  Y2j^= 
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« 


«^+Pfc«+qk  i=l  •'‘+Pi*+qi 


« 


n -  k-1  2 

J2^  TT  * 

X — I —  /  Ti — T” 

®  i=i  “ 


(2.10) 


That  ^21^  ^a^nd  <l>2j^  are  orthogonal  to  all  other  orthonormal  expon¬ 
entials  in  the  form  of  Equation  (2. 10)  can  be  demonstrated  by 

7 

pole -zero  cancellation  . 

One  advantage  of  orthonormal  exponentials  is  the  relative 
simplicity  in  constructing  an  orthonormal  filter  by  cascading  a 
number  of  filter  sections  as  shown  in  Figure  1.  If  a  signal  f(t) 
is  applied  to  the  input  of  the  filter,  the  response  at  the  k'th 
terminal  will  be 

CD 

Ck(t)=  J  f(t-T)cPj^(T)dT  (2.11) 

o 

and  the  least-square  approximation  for  the  signal  prior  to  the  time  t 
will  be 

f(t  -  T  )  «  ^  Cj^(t)  CPj^(T  ),  (0  <  T  <  oo)  .  (2.  12) 

k 

The  error  signal  for  the  approximation  prior  toj^  will  be 

e(t,  t)  =  f(t  -  T  )  -  Y,  Cj^(t) 'Pj^(''’ )  (2.13) 

k 

which  is  a  different  function  for  different  t.  Obviously,  if  instead 
of  f(t),  we  apply  to  the  input  an  impulse  which  is  mathematically 
equivalent  to  Dirac's  delta  function,  6(t),  the  convolution  integral 
shown  in  Equation  (2. 11)  will  then  become 


10 


FIGURE  1  ORTHONORMAL  FILTER. 
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J  6(t  -  t)  cPj^(t)  dT  =  cpj^(t)  (2. 14) 

“  o 

and  the  orthonormal  filter  serves  as  an  orthonormal  exponential 
generator. 

Usually  a  physical  signal  v(t)  starts  from  t  =  0  and  extends 
to  the  future,  and  in  order  to  approximate  it  in  the  least-square 
sense  with  ortho-normal  exponentials,  one  has  to  evaluate  the 
correlation  integral, 

Ck  =  J  v(t)  cPk(''’)dT  .  (2.15) 


We  notice  that  there  is  a  great  similarity  between  the  correlation 
integral  and  the  convolution  integral  of  the  filter  specified  in 
Equation  (2.11).  If  we  let 

f(t)  =  v(-t)  (2.16) 


and  evaluate  the  convolution  integral  at  the  instant  t  =  0,  then 
Equation  (2.12)  become: 


v(t)  cPk(T  )  dT 


(2.17) 


o 

which  is  precisely  the  correlation  integral  shown  in  Equation  (2. 15). 
As  a  result,  the  orthonormal  filter  serves  the  purpose  of 
experimentally  determining  the  coordinates  of  a  signal  v(t)  using 
orthonormal  exponentials  as  basis  functions.  By  applying  the  time- 
reversed  signal  f(t)  to  the  orthonormal  filter,  one  can  measure 
the  coordinates  from  the  output  terminals  at  the  instant  corresponding 
to  the  epoch  of  the  signal.  This  is  the  reason  why  we  make  the 
assumption  that  we  will  be  concerned  mainly  with  the  time-reversed 
signal  f(t). 


The  realization  of  such  an  orthonormal  filter  with  analog 
equipment  is  rather  simple  and  will  not  be  discussed,  here.  For 
digital  computer  realization,  the  well-known  z-transform  technique 
is  required  which  shall  be  discussed  in  detail  in  the  Appendix. 


1  4  2 
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III.  THEOREMS  ON  'COMPLEMENTARY'  OPERATOR 


Since  the  'complementary'  operator  (filter)  plays  a  key  role 
in  our  multiple -epoch  problem,  we  shall  discuss  briefly  some  of  the 
important  theorems  in  this  section.  The  'complementary'  operator 
for  k  pairs  of  exponential  functions  is  defined  as 


7T 


2 

*  -Pi«+qi 

-ir — 7~ 

s  +p.s+q. 


(3.1) 


Comparing  this  equation  with  Equation  (2. 10),  we  notice  that  the 
'complementary'  operator  is  inherent  in  the  construction  of  ortho¬ 
normal  exponentials.  To  demonstrate  its  significance  in  ortho- 
gonalization  of  exponential  functions,  we  assume  a  physically 
realizable  signal 

V(s) 


*  -P4"+q4 

-j— i - -  V'(8) 

■  +Pi®+qi 


(3.2) 


where  V'(8)  maybe  any  function  (not  necessarily  exponentials)  with 
the  only  limitation  that  its  poles  have  to  be  in  the  left  half  plane. 

We  shall  show  that  V(s)  is  orthogonal  to  <&^(s)  and 
Equation  (2. 10)  and  Equation  (3.  2),  we  have 


joo 

J 

joo 

f 

-}CO 

-joo 

V'(s) 

-Joo 

«  -Pl8+qi  8”+p^s+q^ 


“  ■Pl"'*’‘ll  ds 


ds 

2Trj 


(3.3) 


Notice  that  all  the  poles  in  the  integrand  are  in  the  left  half  plane.  It 
is  analytic  in  the  whole  right  half  plane.  Consequently 
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J  V(8)  ^  =  0  (3.4) 

-joo 

and  9|(8)  and  V(8)  are  orthogonal.  Similarly  we  can  8how  that 
3-nd  V(8)  are  alao  orthogonal.  We  have  indeed  proved  the 
statement  made  in  last  section  that  Equation  (2.10)  represents  a 
set  of  orthonormal  functions. 

Another  important  property  is  that  the  'complementary* 
operator  is  a  unitary  operator.  This  can  be  easily  shown  by  the 
definition  shown  in  Equation  (3. 1)  and  by  some  simple  algebraic 
manipulation  that 

Gj^(8)  =  1  (3.5) 

which  is  indeed  the  definition  of  a  unitary  operator. 

In  addition  to  the  properties  stated  above,  there  are  some 
important  theorems  proven  by  Young  and  Huggins^.  We  shall 
simply  state  them  as  follows: 

Theorem  1.  With  signal  f(t)  as  input,  the  output  of  the 
'complementary*  operator,  a(t),  is  simply  the  'present-instant* 
error  of  the  least-square  approximation  of  f(t)  prior  to  the  instant  t. 
Mathematically,  it  may  be  expressed  as 

a(t)  =  €(t,  t)  I  =  €(t,0)  (3.6) 

T  =  o 

where  e.(t,  t  )  is  the  error  signal  defined  in  Equation  (2. 13).  This 
theorem  gives  us  a  new  insight  into  the  properties  of  the  'complemen¬ 
tary'  operator. 

Theorem  2.  The  integral  of  |a(t)|  ^  up  to  the  instant  t  is  equal 
to  the  total  error  energy  for  the  least-square  approximation  of  f(t) 
prior  to  the  instant  t.  In  other  words 
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J  |a(t)|^  dt  =  E(t) 


where 


-00 

00 

E(t)=  f 

o 

le(t.T)|^dT 

■i: 

|f(t-T)|2  dT  - 

■c 

|f(t)|^  dt  -  Y 

Cj^(t)  I 


(3.7) 


(3.8) 


Equation  (3.8)  is  rather  difficult  to  implement  accurately,  especially 
with  analog  equipment,  because  of  the  addition  and  subtraction  of  the 
squares  of  variables.  It  is  obvious  from  Equation  (3.  7)  that 
Theorem  2  provides  us  a  much  simpler  way  to  evaluate  the  error 
energy.  This  is  important  for  our  present  purpose  since  we  use 
E(t)/E(t)  as  one  of  our  criteria  for  epoch  detection.  Notice  that  if 
f(t)  can  be  exactly  represented  by  the  set  of  growing  exponentials 
until  the  appearance  of  first  epoch  t^,  then  the  output  of  the 
'complementary'  operator,  a(t),  will  be  zero  in  the  time  interval 
(-00,  t^).  For  otherwise,  E(t)  would  not  be  zero  according  to 
Equation  (3.  7),  which  is  contradictory  to  our  assumption  that  f(t) 
prior  to  t^  is  exactly  representable  by  the  set  of  exponentials. 

Theorem  3.  If  we  assume  the  input  signal  f(t)  to  be  zero 
for  t  >  0,  i.  e. 

f(t)  =  f(t),  t<0  ,  (3.9) 

=  0  ,  t  >  0 

then  the  output  signal  a(t)  may  be  separated  into  two  parts  such 
that 
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a(t)  =  a'(t)  +  a"(t) 


and 

a'(t)  =  a(t),  t  <  0, 
=0,  t  >  0 
a"(t)  =  0.  t<0 

=  a(t),  t  >  0 


where 


a 


a 


.00 


'(t)  =  J  €(t-T,  0)  gj^(T)  dT  , 

"(t)  =  J  yt-T)gj^(T)  dT  . 


(3.10) 


(3.11) 


(3.12) 


8jj(''’)  i»  the  impulse  response  of  the  'complementary'  operator 
Gj^,  f^(t)  ie  the  leaat-square  approximation  of  f(t)  and  e(t,  0)  is  the 
error  signal  of  this  approximation.  In  other  words,  a(t)  may  be 
separated  in  two  parts  by  a  simple  gate  operation  in  time  domain. 

The  portion,  a'(t)  of  the  signal  prior  to  t  =  0  is  completely  determined 
by  the  error  signal,  while  the  portion  a"(t)  after  t  =  0  is  completely 
determined  by  the  approximating  signal.  Provided  there  exists 
an  inverse  operator,  we  shall  be  able  to  recover  e(t,  0)  and  f_(t) 

cL 

from  them  rather  easily.  For  this  reason  the  signal  a'(t)  is  called 
the  'complementary'  error  signad,  a"(t),  the  'complementary' 
approximating  signal  and  a(t),  the  'complementary'  signal.  This 
theorem  is  of  particular  importance  to  our  case,  as  will  be  self- 
evident  in  the  next  section. 

For  a  signal  f(t)  which  is  not  exactly  representable  by  M 
exponentials,  there  exist  a  set  of  M  exponential  functions  which  is 

4 

optimum  in  the  least -square  sense.  McDonough  has  proven  the 
following  important  theorem. 


CO 


)> 

to 


Theorem  4.  For  a  certain  get  of  M  exponent!,  the  approx¬ 
imating  eignal  energy  will  be  maximum  or  minimum  with  respect 
to  all  other  choices  of  M  exponents  if  and  only  if  the  'complemen¬ 
tary*  error  signal  ie  orthogonal  to  the  aet  of  M  exponential  functions. 
This  theorem  enables  us  to  find  the  set  of  M  exponents  which  is 
optimum  in  the  least-square  sense  by  means  of  an  iterative  process 
as  we  mentioned  earlier. 
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IV.  EPOCH  DETECTION  OF  SIGNALS  WITHOUT  NOISE 

The  multiple -epoch  signals  discussed  in  this  section  are 
signals  without  noise.  Each  individual  signal  is  assumed  to  be 
exactly  representable  by  a  set  of  exponential  functions,  or,  at 
least,  representable  with  relatively  small  error.  Theoretically 
the  error  of  the  approximation  of  any  signal  may  be  reduced  to  as 
small  as  we  wish  by  using  sufficient  number  of  exponential  com¬ 
ponents.  Thus  the  above  assumption  imposes  no  theoretical  lim¬ 
itation,  but  in  practice  it  does  limit  the  class  of  signals  to  which 
our  method  is  applicable. 

The  exponents  of  the  set  of  exponential  components  that 
constitutes  the  individual  signals  may  be  known  or  unknown.  If  they 
are  unknown,  a  modified  Prony's  method  or  McDonough's  method 
may  be  applied  to  find  out  these  exponents.  Since  the  tail  of  the 
multiple -epoch  signal  consists  of  all  the  overlapping  individual 
signals,  the  application  of  the  modified  Prony's  method  would  give 
us  the  value  of  the  exponents  of  all  the  exponential  functions  that 
constitute  the  individual  signals.  The  problem  is  then  reduced  to 
the  problem  of  signals  comprising  known  exponential  functions.  We 
would  like  to  remind  the  reader  that  the  coefficients,  c's,of  the 
individual  signals  on  orthonormal  exponentials  are  unknown.  In 
other  words,  the  signal  space  (or  subspace)  that  contains  all  the 
individual  signal  vector  is  known,  but  the  individual  signal  vector 
per  se  is  unknown. 

Let  us  first  consider  the  simplest  case  of  one  signal  which 
consists  of  m  pairs  of  exponentials.  The  problem  is  to  find  the 
epoch  of  this  single-epoch  signal,  and  then  to  find  the  2m 
coefficients  of  this  signal  on  the  2m -dimensional  orthonormal 
exponential  basis.  The  m  pairs  of  exponential  functions  are 
assumed  known.  Then  one  may  evaluate  as  a  function  of  the  variable 
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t  the  error  energy  E(t)  which  is  the  error  energy  of  the  least-square 
approximation  of  the  signal  f(t)  prior  to  the  instant  t.  Thus  the 
variable  t  may  be  considered  as  a  tentative  epoch  under  testing. 

Since  the  signal  f(t)  consists  of  2m  exponential  functions,  it  is  well 
known  from  the  property  of  exponentials  that  the  signal  in  the  interval 
(-00,  t)  is  also  exactly  representable  by  the  same  set  of  2m  expon¬ 
entials.  As  a  consequence, 

E(t)  =  0,  t  s  t^  ,  (4.1) 

>  0,  t  >  t^ 


because  there  would  be  errors  if  one  tries  to  approximate  the 
signal  f(t)  with  a  tentative  epoch  t  such  that  t  >  t^  where  t^  is  the 
true  epoch  of  the  signal^.  The  error  energy  will  begin  to  increase 
at  the  true  epoch  t^ .  Indeed  it  should  be  obvious  from  Theorem  2 
of  last  section,  E(t)  is  ever  increasing  (or  non-decreasing);  and  as 
a  result 

E(t)  =  a  0  .  (4. 2) 


e 

Now  at  the  epoch  t^,  if  E(t^)  >  0,  then  according  to  Equation  (4. 1) 
E(t.)  E(t.) 

—  =  00,  for  E(^)=  0  ,  (4.3) 

On  the  other  hand,  if  £(t^)  =  0,  then  the  ratio  £](t^)/E(t^)  becomes 
indeterminate.  However  in  that  case  since  E(t^)  is  non -decreasing, 

E  (t^)  !5  0;  and  if  E  (t^)  =  0,  E  (t^)  5t  0,  etc.  Consequently  from 
Equation  (4.3)  and  the  well-known  L'Hospital's  rule  for  indeterminate 
form,  the  epoch  t^  has  the  unique  property  that 

E(t^) 

E(tJT 


■c< 


00 


(4.4) 


Zfl 
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It  should  be  noted  that  this  is  not  true  for  either  t  <  0  or  t  >  0. 

The  reason  for  t  >  0  is  obvious  since  E(t)  >  0  according  to 

Equation  (4. 1).  As  for  t  <  0»  although  E(t)  =  0,  the  time  derivatives 
•  •  • 

E(t),  E(t),  are  also  zero,  thus  giving  the  unique  property  of  the 
epoch  t^  as  shown  in  Equation  (4.4). 

The  reason  of  our  choice  of  epoch  detection  criterion  should 
be  obvious  from  the  above  discussion.  For  signals  which  cannot 
be  exactly  represented  by  the  set  of  exponentials,  but  have  some 
relatively  small  error  in  the  approximation,  the  epoch  detection 
criterion  will  not  give  us  an  infinite  value,  but  a  maximum  near 
the  true  epoch. 

The  evaluation  of  error  energy  may  be  simplified  by  taking 
advantage  of  the  property  of  'complementary'  operator.  The  epoch 
detection  criterion  becomes 


(4.5) 


where  a(t)  is  the  output  at  the  'complementary'  operator  with  the 
signal  f(t)  as  input. 

Next  let  us  assume  two  overlapping  signals  f^(t)  and 
such  that 


f^(t)  =  f^(t).  t  ^  tj 

=  0  ,  t  >  t^ 

f2(t)  =  f2(t),  t  s  t^ 
=  0  ,  t  >  t^ 


(4.6) 


‘z  -  ^1  ^ 


T 

o 


and 


(4.7) 
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The  exponents  of  the  exponentials  constituting  f^(t)  and 
either  known  or  evaluated.  Suppose  there  are  pairs  of 
exponentials  for  f^(t)  and  pairs  for  f2(t)  of  which  pairs 
are  connnnon  to  both  of  them,  then  the  'complementary'  operator  is 


JT 

2 

»  -PiS+q. 
“7 - 

3 

— 1  3 

i=l 

s  +p.s+qj 

j=l 

12 


(•*.8) 


The 


and 


'complementary'  signals  are 


O 

II 

t  <  t^. 

11 

t  >  t^. 

(4.9) 

a2(t)  =  0, 

t<t2. 

=  a2(t), 

t  a  t2, 

in  accordance  with  Equation  (4.6)  and  Theorem  3.  Therefore  the 
total  'complementary'  signal  for  our  two-epoch  signal 


f(t)  =  f^(t)  +  f^(t) 

a(t)  =  0,  -CD  <  t  <  t^  , 

=  a^(t),  tj  s  t  <  t^ 

=  a^(t)  +  a2{t),  t2  s  t 


(4.10) 


(4.11) 


Following  an  argument  similar  to  the  case  of  single-epoch  case, 
we  have 

a^t^) 

a^(t)dt 

-00 


E(t^) 


oo  . 


(4.12) 


I 
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It  should  be  noted  that  the  second  epoch  t2  does  not  have  this 
property  because  in  the  time  interval  the  'complementary* 

signal  a(t)  is  not  zero  as  indicated  in  Equation  (4,11).  The 
generalization  to  n-epoch  signal  is  obvious  and  we  may  state  it  in  the 
following  form. 

Theorem  5.  For  a  multiple -epoch  signal  for  which  each 
overlapping  signal  is  exactly  representable  by  a  set  of  m  pairs  of 
exponentials,  the  first  epoch  t^  has  the  unique  property  that 
E(t^)/E(t^)  is  infinite. 

Let  us  return  to  the  two-epoch  problem  and  try  to  find  a 
solution  for  detecting  the  second  epoch.  Referring  to  Equation  (4. 11), 
we  notice  that 

a(t)  =  a^(t),  t^  <  t  <  t^  +  T^  <  t^  .  (4.12) 

xmder  the  assumption  of  (4.  7).  In  other  words,  in  the  time  interval 
(ti,  t^  +  T^),  the  'complementary'  signal  is  completely  determined 
by  the  signal  f|(t).  Let  us  write  abstractly 

a(t^  s  t  i  t^  +  T J  =  O  [  f^(-oo  <  t  s  t^)]  ,  (4,13) 

where  O  is  an  operator  operated  on  the  signal  f^(t).  The  first 
epoch  t^  has  been  found  by  the  epoch  detection  criterion,  and  as 
a  result,  a  (t^  ^  t  ^  +  T^)  is  known.  If  we  are  able  to  find  an 

inverse  operator  O  we  may  then  recover  the  signal  f^(t)  by  the 
relationship 

f^(-oo  <  t  4  t^)  =  O'*  [a(t^  4  t  s  t^  +  T^)]  .  (4. 14) 

-1 

We  shall  show  that  this  is  indeed  possible,  although  O  is  a  rather 
complicated  operation.  Subtracting  the  recovered  f|(t)  from 
f(t)  =  f^(t)  +  f2(t),  the  remaining  is  then  reduced  to  the  single-epoch 
detection  problem.  Again  the  generalization  from  two  overlapping 


signals  to  3,  4,  ....  n  is  obvious.  Thus,  we  have  the 
following  theorem. 

Theorem  6.  For  a  multiple -epoch  signal  for  which  each 
overlapping  signal  is  exactly  representable  by  a  set  of  m  pairs 
of  exponentials,  the  'complementary*  signal  a(t)  in  the  time 
interval  (t^,  t^  +  T^)  is  completely  determined  by  the  signal  f^(t) 
and  an  inverse  operator  may  be  found  to  recover  f^(t)  from  a(t) 
in  the  time  interval  (t^,  t^  +  T^).  It  is  assumed  that  the  nearest 
epoch  t^  is  such  that  t^  "  ^  ^o* 

The  remaining  part  of  this  section  is  devoted  to  finding  the 
inverse  operator  0~^.  It  is  noted  that  the  operator  O  is  nothing 
other  than  a  'complementary*  operator  G  followed  by  a  truncating 
operation  operated  at  t  =  T^.  It  is  precisely  this  truncating  oper¬ 
ation  which  causes  some  complications  in  deriving  the  inverse 
-1 

operator  O  ,  since  otherwise  a  simple  inversion  of  the  'comple¬ 
mentary*  operator  G  would  give  us  the  desired  result. 

The  signal  f^(t)  consists  of  growing  exponentials,  thus  it  may 

be  written  as 
m 

k=l 

since  ^  defined  as  damped  orthonormal  expon¬ 

entials  in  the  time  interval  (o,  oo).  In  frequency  domain, 
m 

I{'2k-i*2k.l<-'*'2k»2k'-'}- 

k=l 

where  the  notation  ***"  indicates  complex  conjugate, and  ®(s)  are 
defined  in  Equation  (2,10).  Since  a^(t)  is  the  output  of  the 
'complementary*  filter  with  f^(t)  as  input,  its  frequency  domain 
representative  may  be  written  as 
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m 


where 


“ak-l*"  '  °m<-'  *2k-l'-' 


-7^  s  "> 

JT 

» i=k+i 


s  -Pje+q. 
8^+p.s+q. 


“2k'-»=°m<‘'  *2k<-“> 


J^k  -TJ 


(4.18) 


It  is  Interesting  to  note  that  the  set  of  function  U(s)  are  ortho¬ 
normal  exponentials,  and  furthermore,  they  are  damped  expon¬ 
entials  as  it  should  be. 

For  the  two-epoch  problem,  we  can  only  obtain  at  the  output  of 
'complementary'  operator  a(t)  rather  than  a^(t).  The  available 
information  of  a^(t)  is  contained  in  the  time  interval 
according  to  Equation  (4. 12).  Thus 


a(t)  =  Y,  c.u.{t-t^) 


for  tjS  t  St.  +  T 
1  1  o 


(4.19) 


The  time  translation  of  Uj(t)  (which  corresponds  to  U.(8)  is 
necessary  for  the  coincidence  of  origin.  We  wish  to  find  c|s  from 
the  known  basis  function  u!s  and  a(t)  in  the  time  interval 
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where  are  complex  conjugates  as  functions  of  t  which 

may  be  measured,  then  the  deterministic  signal  at  the  instant 
t  +  T  will  be 


'.<*  +  ’  >  = ‘  'i- 

t  +  T  £t,  .  (5.3) 


h  (t  +  T ;  t)  is  defined  as  the  extrapolated  signal  at  the  instant 
8 

t  +  T  based  on  the  measurement  at  t.  t  may  be  positive  or 
negative  depending  on  whether  we  are  interested  in  extrapolating 
the  future  value  or  the  past  value.  Mathematically  it  may  be 
written  as 


V  ^  (a.  -jP.)(t+Tk 

hg(t+T,t)=  ^  ^  ^  +yt)e  ^  ^  } 


k=l 


(5.4) 


Here  we  deal  with  ordinary  exponentials  rather  than  orthonormal 
exponentials  for  the  clarity  of  presentation.  The  two  forms  are 
related  to  each  other  by  a  simple  linear  transformation. 

That  Equation  (5. 3)  holds  true  is  the  result  of  continuity  of  the 
deterministic  signal  fg(t)  and  all  its  derivatives  for  -oo<  t  <  t^. 
The  epochs  have  the  unique  property  that  it  is  the  continuation 
of  the  past  while  it  marks  the  beginning  of  discontinuity  as  shown 
in  Figure  2A.  This  property  may  indeed  be  considered  as  the 
definition  of  an  epoch.  This  property  is  not  clearly  visible  when 
the  discontinuity  is  in  the  high  order  derivatives.  It  is  also 
masked  when  the  signal  is  corrupted  by  random  noise.  However, 
a  likelihood  ratio  criterion  based  on  this  property  gives  us 
remarkable  results  for  epoch  detection. 

The  likelihood  test  is  well-known  in  statistical  commxmication 
theory  for  the  test  of  hypotheses.  One  of  the  simplest  hypothesis 


W 


'1  4  2 
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tests  is  to  test  the  hypothesis  that  certain  observations  are 

distributed  according  to  a  Gaussian  distribution  with  nnean  nn^  and 

variance  o^,  against  the  alternative  hypothesis  H.  which  is  a 

^  2 


Gaussian  distribution  with  mean  and  variance  o 


Based  on  the 

level  of  the  test,  a  threshold  t)  may  be  set  for  the  likelihood  ratio 


Pi{y) 


=  exp  (y-m^)^  + y-m  )^1  .  (5.5) 

2o  2o 


The  level  of  test  is  in  turn  pre -determined  in  accordance  with  the 

cost  of  rejecting  when  in  fact  is  true  and  that  of  accepting 

H  when  in  fact  H.  is  true.  If 
o  1 


P.ly) 

p-fy)  ^  ’1  *  (5.6) 

we  then  reject  the  hypothesis  and  assume  that  is  true. 

To  adapt  this  idea  to  our  problem,  we  notice  that  our  signal 
is  corrupted  with  random  noise  so  that  it  may  be  written  as 

w)  =  y +  ^n<‘> + •  <5.7) 

where  f  (t)  is  the  random  Gaussian  noise.  The  random  noise  is 
n 

of  zero  mean  and  unknown  variance.  Consequently,  the  noisy  signal 
f^^^(t)  may  be  regarded  as  a  random  distribution  with  the  determinis¬ 
tic  signal  fg(t)  as  its  mean.  In  other  words,  for  the  noisy  signal 
fg^^(t),  the  mean  value  varies  with  time  according  to  the  variation 
of  the  deterministic  signal  ^g(f)>  while  the  randomness  is  completely 

contributed  by  the  noise  f  (t).  For  the  unknown  variance,  we  may 

”  2 

simply  assign  to  it  a  value  a  .  The  noise  is  assumed  independent  of  the 
deterministic  signal,so  that  the  measurements  of  orthonormal  filters  at  any 


O 


/ 


I:  ^  z 
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instant  t  are  not  affected  (actually,  there  is  a  very  small  effect) 
by  the  noise,  nor  are  the  extrapolations.  Indeed,  we  shall  not 
make  the  distinction  between  the  extrapolation  based  on  the 
noisy  signal  deterministic  signal  1^(1).  The 

notation  h^(t  +  t  ;  t)  may  be  interpreted  as  extrapolated  signal 
at  the  instant  t  +  T  based  on  the  measurements  of  the  noisy  signal 
f^_l_^(t)  at  the  instant  t. 

The  noisy  signal  niciy  be  regarded  as  a  particular  mem' 

ber  of  an  ensemble  of  multi -dimensional  gaussian  distribution. 
Suppose  we  sample  the  signal  N  instants.  where  i  =  1.  2, 

....  N.  the  probability  of  this  particular  member  of  an  ensemble 
with  mean  i*  then 

^  2 

{-17  I  LWi'-w]}-  <=•»' 

It  is  more  convenient  to  express  the  probability  in  terms  of  the 
logarithm.  Thus,  as  N  approaches  infinity,  we  have  in  the  limit 

log  p  .  ‘  J  [  .  y,)]  dt  .  (5.9) 

2a 

It  is  indeed  unnecessary  to  tsdce  the  limit  since  we  shall  use  a 
digital  computer  for  calculation,and  the  signal  has  to  be  sampled. 
Nevertheless  the  integral  expression  does  facilitate  our 
following  discussion. 

As  we  mentioned  earlier,  the  epoch  has  the  unique  property 
that  it  is  the  continuation  of  the  past  while  it  marks  the  beginning 
of  discontinuity.  To  make  it  more  clear,  let  us  assume  a  two- 
epoch  deterministic  signal  as  shown  in  Figure  2  such  that 


-32- 


f3l(t)  =  f3i(t).  t  <  t^. 

=  0  ,  t  >  t^. 

^b2^^^  "  ^  ^2’ 

=  0  , 

(5.10) 

^2  -  *1  ^  '^o 

and 

(5.11) 

's+n<‘)  =  's(‘)  + 

=  fgl(t)  +  fg2(t)  +  yt) 

(5.12) 

Consider  the  first  epoch  t^,  since  it  is  the 

continuation  of  the  past 

fg(t^)  =  hg(t^  -  T  ;t},  T  >  0  , 

(5.13) 

as  we  discussed  at  the  beginning  of  this  section.  Because  of  the 
discontinuity  of  the  deterministic  signal  or  of  its  derivatives,  the 
relationship  is  no  longer  true  for  extrapolation  into  the  future,  viz 

(5.14) 

One  would  wonder  whether  there  is  a  way  of  extrapolation  which  is 

equal  to  f  (t.  +  t  ).  Indeed  there  is.  Recalling  Theorem  6, 

®  *  -1 

we  have  an  operator  O  which  enable  us  to  recover  fgj(t)  from  the 
'complementary'  signal  a(t)  in  the  time  interval  t^  s  t  s  t^  +  T^. 
Subtracting  from  fg(t)  gives  us  ^  result,  there 

is  am  extrapolation  b^(t|  ±  x  ;  t^)  which  is  based  on  the  measure¬ 
ments  at  tj  and  the  'complementary'  signal  a{t)  for  t^<  tst^  + 
such  that 

h^{t^  ±  T,  t^)  =  ±  T  ), 


(5.15) 
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Since,  according  to  Equation  (5.10),  (5.11)  and  (5.12), 

<,(t)  =  t  s  t,  (5.16) 

we  have  the  important  relationships  that 

yt^  -  T  )  ^  h^(t^  -  T  ;  t^).  0  <  T  (5.17) 

and 

fg(ti  +  T  )  =  he  (ti+T  :ti),  0  <  T  s  (5.18) 

The  four  Equations,  (5.13),  (5,14),  (5.17),  and  (5. 18)  mathematically 
describe  the  property  of  the  first  epoch  t^  of  a  two-epoch  signal. 

(See  Figure  2).  They  are  also  true  for  a  n-epoch  signal.  Thus  we 
have: 

Theorem  7.  For  a  multiple -epoch  deterministic  signal 
consisting  of  overlapping  signals  which  are  individually  exactly 
representable  by  a  set  of  exponential  functions,  the  first  epoch  t^ 
has  the  properties  describedby  Equations  (5,1 3),  (5.14),  (5. 17)  and 
(5.18). 

It  should  be  noted  that  since  we  assume  the  noise  to  be  inde¬ 
pendent  of  the  deterministic  signal,  the  extrapolations,  hg(t^'t  t  tt^) 
and  ±  T  ;t^)  are  obtainable  from  the  measurements  of  the  noisy 

signal  at  t^.  We  may  similarly  obtain  hg(t  ±  T;t)  and  h^(t±T;t) 

for  any  instant  t  where  h^(t  ±  T;t)  is  defined  by  the  complex  operation 
consisting  of  the  'complementary'  operator,  the  inverse  operator 
O  ,  the  measurements  of  the  orthonormal  filter  at  the  instant  t, 
and  extrapolation  based  on  them.  The  extrapolations  has  the  proper¬ 
ties  such  that 

fg(t  ±  T  )  =  hg(t  ±  T;t)  =  hj,(t  ±  T;t) 

for  T  <  T  and  t  <  t.  -  T 
o  1  o 


(5.19) 
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where  we  have  used  as  a  basic  time  unit.  The  first  identity  is 
obvious  because  of  the  continuity  of  the  deterministic  signal  and  all 
its  derivatives  in  that  time  interval.  As  for  the  second  identity 
in  Equation  (5. 19)i  it  is  because  of  the  independence  of  the  noise 
from  the  exponential  functions, so  that 

0‘^  [a(t  s  t' s  t  +  T^)]  =  0  (5.20) 

for  t  s  t .  -  T  , 

1  o 

although  a(t')  in  that  interval  is  not  absolutely  zero  but  consists  of 
noise.  Consequently,  there  is  nothing  to  be  subtracted  from  the 
original  noisy  signal  and  the  extrapolation  h^(t  ±  t;  t)  is  equivalent 
to  h^(t  ±  T;t).  On  the  other  hand  for  t  much  later  than  t^  we  have, 

f  (t  ±  T)  ;i<h  (t  ±  T;  t) 

8  Q 

?^h^(t±T;t)  (5.20) 


for 


T  s:  T  and  t  s  t.  +  T 
o  1  o 


A  transition  region  of  course  exists  between  t^  -  and  t^  +  T^, 
with  the  epoch  t^  having  the  important  property  prescribed  in 
Theorem  7. 

Returning  to  hypothesis  testing  of  mean,  the  mean  value  of 
our  noisy  signal  in  the  time  interval  (t,  t  +  T^)  may  be  h^(t+T;t), 
h^(t+T;t)  or  none  of  them.  At  the  epoch  t^,  the  noisy  signal  should 
have  a  mean  which  equals  to  h^(t4-T;t)  according  to  (5. 18).  As  a 
result,  the  logarithm  of  a  likelihood  defined  as 
-1  r  "^o  j" 


Log  = 


2o 


T 

r  ° 

o 


's+n<‘+") 


,(t+T;t)] 


dT 


_1 

Zo 


-,2 


o 


(5.21) 
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should  have  a  relatively  large  positive  number  at  t^.  Similarly 
one  may  define  a  likelihood  ratio  based  on  extrapolation  over  the 
past  as 

CO  o 
T 

I  °  '*’■  •  <5-“> 

2a  o 

which  again  should  be  a  positive  number  for  t  =  t^  in  accordance  with 
Eqxiation  (5. 13)  and  (5. 17).  One  may  also  define 


logCg  = 

-1 

2a^ 

o 

r 

1 

T 

;  ° 
0 

dT 

(5.23) 

to 

and 

log  = 

1 

2a  ^ 

2 

d  T 

(5.24) 

2a 

T 

J  ° 

o 

dT 

Again  these  two  functions  should  have  relatively  large  values  at 

t  =  t^.  For  t  s  t^  -  T^,  theoretically  all  these  four  equations  reduce 

to  zero.  As  to  the  case  when  t  2  t.  +  T  ,  the  situation  becomes 

1  o 

obscure.  However,  we  intuitively  expect  that  in  general,  the  values 

of  above  four  equations  for  t  s  smaller  th2Ui  at 

t  =  t^,  simply  because  for  the  former,  the  mean  of  f^^^^  follows 

neither  of  the  extrapolations,  while  for  t  =  t^,  in  all  four  likelihood 

ratio  equations  the  mean  of  should  equal  to  one  of  the  extrapolations 

but  not  the  other.  This  does  not  exclude  the  possibility  that  at  a 

certain  instant  t'  >  t^  -I-  T^,  a  certain  likelihood  ratio  is  larger  than 

at  t^,  since  our  problem  is  statistical  in  nature.  Furthermore  there 

is  the  transition  interval  t.  -  T  attst.  +  T, 

1  o  1  o 
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To  minimize  the  above-mentioned  possibilities  which  would 
cause  the  detection  of  a  wrong  epoch,  we  set  up  a  threshold 

Ti  =  0  (5.24) 

such  that  an  epoch  must  satisfy  the  four  necessary  conditions, 
namely 

logCf  i  ^ 
log4p  i  r\ 
log&^  >  n 

logC^  S’!  ,  (5,  25) 


These  inequalities  are  not  sufficient,  and  we  detect  the  epoch  by  the 
criterion 


log  t(t  )  =  max 

®  '  max' 

(5.26) 

00 

among  all  possible  epochs,  where 

M 

(S.ll) 

is  a  function  of  t.  Equation  (5.  25)  eurid  (5.  26)  summarize  our  method 
of  detecting  epoch. 

To  detect  the  second  epoch  t^  after  the  detection  of  t^,  we 
again  utilize  Theorem  6  to  recover  f|(t)  and  reduce  the  problem  into 
the  same  form  of  detecting  epoch  t^ .  The  generalization  into  the 

detection  of  t^,  t^ . t^  is  obvious  by  iteration  of  this  same 

process. 

We  would  like  to  say  a  few  words  about  the  variance.  We 
notice  that  in  the  likelihood  ratio  equations,  only  serves  as  a  scale 
factor.  It  will  have  no  effect  on  Equation  (5. 25)  since  we  assume 
q  =  0.  A  change  of  the  value  of  variance  will  change  the  values  of  the 
likelihood  ratio,  but  it  certainly  will  not  change  the  value  of  t 

in&x 

which  corresponds  to  maximum  value  of  Ut).  If  we  are  interested 


in  a  threshold  other  than  zero,  however,  Equation  (5.  25)  is 

2 

certainly  affected  by  the  value  a  ,  and  a  knowledge  of  the  variance 
of  the  random  noise  becomes  important. 

Sinusoidal  signals  are  particular  cases  of  exponential  signals, 
emd  as  such  the  procedure  described  in  this  section  should  be 
applicable  to  multiple -epoch  sinusoidal  signals.  Certain 
modifications  are  required  for  the  procedure  mainly  because  the 
poles  of  sinusoidal  signals  are  located  on  the  imaginary  axis  rather 
than  in  the  left-half  plane.  We  shall  not  go  into  detail  for  the 
procedure  for  sinusoidal  signals,  but  simply  say  that  it  is  much 
simpler  than  the  exponential  signals. 
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VI.  EXPERIMENTAL  RESULTS 

Let  us  summarize  the  procedure  for  the  detection  of  multiple - 
epoch  signals. 

1)  The  exponents  of  exponential  ftmctions  that  form  our 
deterministic  signal  are  assumed  known  or  have  been  estimated 
from  Prony's  method  or  McDonough's  method. 

2)  An  orthonormal  filter  is  constructed  to  measure  the  noisy 

signal  for  each  instant  t. 

3)  Likelihood  ratios  are  calculated  for  each  instant.  Based  on  the 
criteria  in  Equation  (5.  35)  and  (5.  26),  the  first  epoch  t^  may  be 
detected. 

4)  The  deterministic  signal  fg|(t)  which  corresponds  to  epoch 
t^  is  then  obtainable  from  the  'complementary'  signal,  and  may  be 
subtracted  from  the  noisy  signal 

5)  The  second  epoch  may  be  detected  in  the  same  way  as  the 
first  epoch  from  the  signal 

6)  Similarly,  t^,  t^.  ,  ,  t^^  may  be  detected  and  the  deterministic 
signal  f  (t)  is  properly  represented. 


With  this  procedure,  a  multiple -epoch  signal  with  noise  shown 
in  Figure  3  is  represented  by  exponential  function.  The  individual 
deterministic  signals  are  exactly  representable  by  exponential 
functions  and  the  exponents  are  known.  Figure  3B,  3C,  and  3D  are  the 
logarithm  of  the  likelihood  ratios  log  ^  for  the  detection  of  1st,  2nd, 
and  3rd  epoch  respectively.  Figure  3E,  3F,  3G  are  the  individual 
signals  measured  and  Figure  3H  is  the  sum  of  the  three.  Figure  4 
is  similar  to  Figure  3  except  that  the  exponential  functions  used 
to  represent  the  overlapping  signals  are  not  exactly  matched  to  the 
deterministic  signals.  They  are  e^'^*  and  e^*  compared  with 
e^^  and  e^  which  constitute  the  original  signals,  thus  showing  that 
our  method  does  not  require  that  the  component  functions  match 
the  signal  exactly.  The  remarkable  results  are  self-evident. 


We  observed  aui  interesting  result  from  these  two  examples 
that  the  epochs  could  be  detected  by  the  likelihood  ratio  alone 
which  was  defined  in  Equation  (5.  24).  This  is  probably  due  to  the 
particular  waveshape  of  our  signal.  The  reason  is  not  clear  to  us 
at  the  moment  and  deserves  further  investigation. 
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APPENDIX  -  Discrete  Orthonormal  Exponentials 


10 


Since  the  procedure  of  multiple -epoch  signal  representation 
is  most  conveniently  carried  out  on  a  digital  computer,  we  shall 
deal  with  orthonormal  exponentials  in  discrete  form  (that  is,  sam¬ 
pled  data  form).  We  notice  that  the  sampled  data  form  of  continuous 
orthonormal  exponentials  which  are  mathematically  expressed  by  their 
z-transforms,  are  not  orthogonal  to  each  other  in  z-domain.  The 
z -transform  of  a  signal  involves  the  values  of  the  signal  at  equal¬ 
spaced  instants  separated  by  the  sampling  interval 


s 

where  (1)^  is  the  sampling  frequency.  According  to  the  sampling 
theorem,  only  a  signal  having  a  frequency  spectrum  lower  than 
U)  is  exactly  reproducible  from  the  sampled  data  by  the  cardinal 
function.  However  the  orthonormal  exponentials  which  vanish 
identically  over  half  of  the  t  axis  have  a  non-zero  spectrum  extend¬ 
ing  over  almost  all  frequencies.  As  a  result,  orthogonality  in  the 
s -domain  does  not  yield  orthogonality  in  z-domain  representatives 
of  these  continuous  functions.  To  avoid  this  difficulty,  we  choose 
at  the  outset,  discrete  basis  functions  which  are  orthogonal  in  the 
z-domain  corresponding  to  the  s-domain  poles  of  the  continuous 
orthonormal  exponentials.  The  zeros  are  different,  however,  al¬ 
though  they  are  chosen  in  such  a  way  that  as  the  sampling  interval 
approaches  zero,  our  chosen  basis  functions  will  approach  the 
s-domain  orthonormal  exponentials. 

Given  a  function  f(t),  the  sampled  values  of  this  function  at  the 
sampling  interval  may  be  written  as 


f®(t)  =  f(t)  X  i  (t)  ,  (A.  2) 

where  i(t)  represents  a  series  of  unit  impulses  equally  spaced  in 
time 
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00 


i(t)  =  ^  6(t-nT) 

n=0 


(A.  3) 


The  frequency -domain  representative  of  this  train  of  unit  impulses 
is 

T/  \  A  A.  “sT  ,  -2sT 
I(s)=l  +  e  +e  +... 


i-e 


TT 


(A,  4) 


Suppose  the  sampled  value  of  the  signal  f(t)  at  the  n'th  sampling 

instant  is  f  ,  then 
n 

f*{t)=  ^  f^6(t-nT)  (A.  5) 


and 


F-(.)=  I 


-nsT 


n 


Define 

then 


z  =  e 


F*(z)H  f®(8)  =  ^  f^z'"  . 


(A.  6) 
(A.  7) 


n 


For  example,  consider  a  simple  exponential  signal  exp  (-at)  for 
t  2  0;  its  sampled  value  will  be 

^  .  -2aT„-2^ 

1  +  e  *  +e  z 


A  ^-at  -1 
1  -e  z 


(A.  8) 


One  should  notice  that  the  z-tremsformation  is  a  linear 
13 

transformation)  thus,  if 


o 


7.  T7 
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VH 

GO 


c,  e 
k 


«t)  =.  I 

k 

which  is  equivalent  to 


•k* 


F( 


..=  1 


8-8, 


then,  by  Equation  (A.  8) 


■(.)  =  I 


.  V  -1 

1-e  z 


(A.  9) 


(A.  10) 


(A.  11) 


Since  Cj^  is  the  residue  of  F(s)  with  a  pole  at  s  =  Sj^,  it  follows  from 
Cauchy's  integral  theorem  that 


■(.)  = 


F{\) 

'  '  VT 

1-e  z 


dX 

lirj 


(A.  12) 


where  the  contour  encloses  those  singularities  belonging  to  F(8)  only. 

A  similar  argument  gives  us  the  inverse  transformation 

=  J  ,  s-Cl^inz  ^ 

^  0 

where  the  contour  c'  encloses  the  poles  of  F  (z)  only. 

With  these  two  transformations  between  F(8)  and  F“(z)  derived, 
the  z -transforms  of  the  continuous  orthonormal  exponentials  can  be 
easily  found.  Take  the  first  pair  of  orthonormal  exponential  functions 
which,  according  to  Equation  (2. 10),  are 


.,(•)  =  ^ 


(A.  14) 


s  +ps+q 

VZpq 

2 

8  +p8+q 


where  we  have  used  p,  q  instead  of  for  simplicity.  Substituting 

into  Equation  (A.  12),  we  have 


z^-ze’‘^^r(a/p)sinpT+co8pT  1 


z  -2ze 


cospT+e 


(A.  15) 
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*8,  V  n —  ze'°''^(l/P)8inPT 


z  -2ze  co8(3T+e 


loT? 


where  a  and  p  are  defined  ae 


*=f _ 

p  ,Jq-lp/2)^  (A,  16) 


which  are  the  eame  ae  Equation  (2.  4). 

Theee  equatione  would  appear  to  yield  the  eampled-date 
equivalent  of  the  orthonormal  exponentiale.  However  a  more 

detailed  inveetigation  of  Equation  (A.  15)  reveala  that  and 

8  * 

^2(2)  8.re  not  orthogonal.  Indeed  they  are  not  even  normalized. 

One  would  have  great  difficulty  in  ueing  theee  im- orthonormal 

functions  for  signal  representation. 

The  reason  that  Ifr^(z)  and  are  not  orthonormal  is  as 

follows:  Referring  to  Equation  (A.  12),  we  notice  that  the  contour  is 

taken  in  such  a  way  that  the  integral  represents  the  sum  of  the 

residues  of  the  integrand  at  the  poles  of  F(X).  The  result 

will  be  the  same  except  for  a  sign  change,  if  we  take  the  residues  of 

the  other  part  of  the  integrand.  In  other  words,  for  the  integrand  of 

Equation  (A.  12). 


F(\) 

nr: 


l-e 


1 


F(\) 


(A.  17) 


The  poles,  excluding  those  of  F(\),  will  be 

\  =  s  (A.  18) 

with 


O 

>- 


n=0,  dkl,  i2,  ... 
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r* 


oc 


Thus  Equation  (A.  12)  may  be  written  as 
00 


•(.)  =  -  I 


n=  -  00 


F(M  1 

'v  = 


I 


n=-  00 


F(8  +  jnu)^) 


where 

2ir 

‘“s  “  T" 


(A.  19) 


is  the  sampling  frequency  .  Assume  that  signal  f(t)  has  a  frequency 

spectrum  as  shown  in  Figure  5(a),  the  sampled  signal  has  a 

spectrum  reproduced  without  modification  provided  uu  <  tu  /2.  On 

Ct  8 

the  other  hand,  if  UJ  >  (U  /2.,  distortion  arises  due  to  the  overlapping 
as 

of  the  spectra  separated  ui  apart  ■  In  order  to  recover  the  signal 
from  the  sampled  data,  it  is  necessary  that 


>  2u)^  ,  (A.  20) 

8  et 

or  it  may  be  written  as 

2WT  <  1  (A.  21) 

where 

'"a 

W  =  ^  (A.  22) 


*  Strictly  speaking, 
F®(z)  =  F®(s) 


Equation  (A.  19)  should  be 
00 

=  Y  Y,  F(s  +  jnu)^)  +  Jf(0‘^)  . 
n=-oo 


-6- 


Spectrum  of  f  (t) 


-  <*>a  0  ^0 


Spectrum  of  f*(t)for  >  Z(jJq 


-2<u,  -0),  -aig  0  Wq  Wg 


Spectrum  of  f*(t)  for  <  2cUg 


FIGURE  5 


SPECTRUM  OF  SAMPLED-DATA  SIGNAL. 
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This  is  indeed  the  sampling  theorem  .  We  would  like  to  remind 
the  reader  that  except  for  pure  sinusoidal  signals,  orthonormal 
exponentials  have  non-zero  spectra  extending  to  infinity,  and 
consequently.  Equation  (A.  20)  can  never  be  satisfied.  As  a  result, 
the  z -transforms  shown  in  Equation  (A.  15)  are  distorted  representa¬ 
tives  of  orthonormal  exponentials,  and  hence  not  orthogonal 
themselves. 

From  the  Parseval  relation,  one  realizes  that  in  the  frequency 
domain,  the  orthonormal  condition  for  two  functions  and  4^^  is 


I 


joo  * 

4- .(-s)  ll'jts) 

joo 


ds 

IrtJ 


=  6.. 

ij 


(A.  23) 


where  is  the  Kronecker  delta.  By  the  definition  of  £  shown  in 
Equation  (A.  6)  so  that 


dz  =  Te®^d8 


Equation  (A.  23)  may  be  transformed  into  the  form  of 

f)(4-®(l/z)f  +«(z)  6.. 


(A.  24) 


(A.  25) 


which  is  indeed  the  condition  of  orthonormality  in  z -domain.  Notice 
that  in  Equation  (A.  25),  the  contour  of  integration  is  along  the  unit 
circle. 

Let  us  take  a  pair  of  complex  poles  and  ,  and  assume 
that  there  exist  a  pair  of  discrete  orthonormal  functions 


»Vj(z)  =  b^ 
+2(z)  =  b^ 


2 

z  -n^z 

)jc 

(z-z^)(z-z^) 

2 

z 

iQt 

(z-z^)(z-Zj) 


(A.  26) 
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where  and  |i2>  '*3.1  numbers,  and  and  b^  are  normalization 

constants.  The  condition  of  orthogonality  requires  that 


K+;(*Ar*5'«) 


l.,bj 


or  that 


(A.  27) 

(A.  28) 


Therefore  one  may  choose  any  value  of  and  (x^  as  long  as  they 
satisfy  Equation  (A.  28).  One  simple  choice  is  to  let 


=  1 

P2=  -1 

which  does  satisfy  Equation  (A.  28).  Then 


(A.  29) 


»lij(z)  =  b^ 


Z^.z 


(z-z^)(z-z^  ) 


*l  (’‘I  =  >>2 


2. 

z  +z 


(Z-Zj)(z-Z^) 


(A.  30) 


where  the  normalization  constant  can  be  evaluated  easily  as 


W 


'►r- 


I 

1 

} 

i 

I 


I 
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ea 


T 

T'*- 


(z^+z*)  + 


1*4 1 


1/2 


(A.  31) 


For  a  pair  of  s -domain  poles 


8^  =  -  a+jp 
* 

=  -a-jp 


the  corresponding  z -domain  poles  will  be 
z,  =  e'*’'  =  e-“'^  ^ 


(A.  32) 


Then  the  poles  of  the  'P's  shown  in  Equation  (A.  30)  are  indeed  the 
same  as  the  poles  of  the  9's  in  Equation  (A.  15).  Furthermore,  as 
the  sampling  interval  approaches  zero,  the  zeros  of  become 
the  same  as  that  of  4*1^  •  If  instead  of  J  2p,  we  assign  to  *J(z)  a 
normalization  constant  in  the  z -domain,  then 

Lim  *J(z)  =  ipjiz)  .  (A.  34) 

T-  0 

Since  9^{z)  is  the  sampled  value  of  a  continuous  exponential  function 
approaches  the  z-transform  of  cp^(t)  as  the  sampling 
interval  T  approaches  zero.  The  relation  between  *^*1  *2^*) 

is  not  so  obvious  due  to  the  peculiarity  of  the  zero  of  ^  =  I 

which  corresponds  to  the  zeros  at  ±  in  s -domain.  However, 

owing  to  the  location  of  the  poles  of  ^'s  and  ^i's.  Equation  (A.  15)  and 
Equation  (A.  30)  indeed  describe  the  same  two-dimensional  signal 
space.  Since  cp.(t)  and  orthogonal,  and  so  are  ^'.(z)  and 

S  B 

our  conclusions  are  that  as  approaches  zero,  4^2^*^ 
approaches  the  z -transforms  of  the  continuous  orthonormal  exponential 
cp2(t). 


/ 
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As  we  discuBsed  in  Section  HI.  the  'complementary*  operator 
plays  a  central  role  in  the  orthogonalization  of  continuous  expon¬ 
ential  functions.  This  is  also  true  for  the  discrete  case.  In  fact, 
all  the  theorems  concerning  the  'complementary'  operator  may 
easily  be  carried  over  to  the  discrete  case.  The  'complementary' 
operator  in  z-domain  may  be  written  as, 

JT  *i‘i* 

i  =  i 


*i  *r 

(z-Zj)(z  -  z.) 


(A.  35) 


Following  the  ideas  of  'complementary'  operator  and  the  orthogonality 
in  the  z-domain,  a  set  of  discrete  orthonormal  exponentials  may 
be  written  as 


z^-s 


"  ^2k-l  ;  ^k-1^®^ 


^  ^2k 


(Z-Zj^)(z-Zj^) 

2^ 

*  +®  It\ 


(Z-Zj^)(z-Zj^) 


(A.  36) 


where 


b 


2k- 1 


(l-|Zj^|^[l  +  (Zj^+Zj^*)  + 


1/2 


'’Zk={7<*-  I'kl']}  • 


> 


The  poles  in  the  z-domain  are  related  to  the  poles  in  the  s -domain 
in  such  a  way  that 


(A.  38) 


{-V3Pk>’r 

e 


We  have  asaumed  that  the  cardinal  functions  are  used  as  the 
components  for  sampled  data.  As  the  sampling  interval  T  approaches 
zero,  our  discrete  orthonormal  approach  the  ordinary  continuous 
orthonormal  exponential  functions. 


